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5 BACKGROUND 

In a large scale computer system, such as a database management system 
(DBMS), it is important to be able to support a number of different users concurrently. 
Without such a capability, the system would be little more than a standalone computer. 
To implement multi-user support, several different processing models have been 
1 0 utilized. One model that has been used is the multi-processing model. In multi- 
processing, each time a new user requests access to the system, a separate process is 
started. This process is in essence a separate execution of the software. Once started, 
the process services all of the requests from the user that spawned it. Under the multi- 
processing model, each process has its own separate memory space for use in storing 
1 5 and processing data. 

Multi-processing is effective for supporting multiple users concurrently; 
however, it has severe scalability limitations. This is due mainly to two factors. First, 
spawning and maintaining a process involves a significant amount of overhead. 
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Because of the high cost, only a small number of processes can be maintained at any one 
time. Second, the same set of data, used by multiple processes, may be stored 
redundantly; once in each process' memory space. This redundancy can waste a 
significant amount of system resources. 
5 To overcome some of the limitations of multi-processing, the multi-thread 

model was developed. According to the multi-thread model, there is only one execution 
of the software. That is, only one process is spawned. From this one process, multiple 
threads can be spawned to perform the work necessary to service user requests. 

Multi-threading has several advantages over multi-processing. First, because 

1 0 only one process is spawned, overhead is kept to a minimum. It is true that each thread 
carries with it some overhead cost, but this cost is negligible when compared with the 
cost of maintaining an entire process. Because multi-threading significantly reduces 
system overhead, many more users can be supported. Another advantage of multi- 
threading is that it minimizes the redundant storage of data. Because all of the threads 

15 are part of the same process, all of the threads can share the same memory space. This 
in turn makes it easier to implement a shared cache. 

With a shared cache, it is only necessary to store a set of data once. After the 
data is cached, all of the threads can access it. By reducing redundant storage of data, 
multi-threading makes more efficient use of system resources. 

2 0 Implementing a shared cache gives rise to increased efficiencies. However, a 

shared cache is not without its disadvantages. One of the drawbacks of a shared cache 
is that it can be difficult to render a set of data in the cache visible to only one user (i.e. 
to make the entry "private" to the user). As noted above, once an entry is stored in the 
shared cache, that entry is accessible to all threads. In certain applications, it is 

2 5 important to be able to make a cache entry private to a single user. One application in 
which this ability is important is in on-line analytical processing (OLAP). 
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An OLAP system is typically used to provide decision support services, such as 
forecasting, financial modeling, and what-if analysis. In performing what if analysis, an 
OLAP system typically performs at least three operations: (1) it retrieves historical data 
from a databases; (2) it changes the data in accordance with a what-if scenario posed by 
5 the user; and (3) based on the changed data, it determines what other data is changed. 
What-if analysis is a powerful tool because it allows a user to forecast how a change in 
one area may affect another. For example, a user may use what-if analysis to predict 
how sales in a region may change if the sales force is increased by ten percent. 

As noted above, one of the operations performed in a what-if analysis is to 

1 0 change the retrieved historical data. This change typically is not an actual change but a 
proposed "what-if change. Because it is not an actual change to the data in the 
database, only the user making the change should see it. All other users should still see 
the original data, hi such a situation, there is a need to make the proposed change 
private to the user making the change. In a typical shared cache, however, the only 

1 5 mechanism for making a cache entry private is to employ locks, which typically require 
additional overhead and can result in deadlocking between threads competing for the 
resource. Hence, there exists a need for a mechanism that can support private data 
without hindering performance. 

SUMMARY OF THE INVENTION 

2 0 In accordance with a preferred embodiment of the invention, a public memory 

structure is utilized to store data which is sharable between a plurality of users in a 
multi-threaded computing environment, hi contrast to the prior art, a cache memory 
area on a server is used to store public, sharable data and private, non-sharable data 
without using locks to negotiate resource ownership. Consequently, there are public and 

2 5 private pages stored in global memory. The private pages are those that are modifiable 
by a user and the public pages are those that are only readable by one or more users. 
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One aspect of the invention is to manage memory on a computer. From the 
memory there are a plurality of cache memory blocks cooperatively shared by 
processing threads executing on the computer. These processing threads include user 
sessions and resource managers. 

5 The user threads consume page data stored on the cache memory blocks. Each 

user thread has a public view of unmodified cached pages and can have modified cached 
pages in a private view. During on-line analytical processing (OLAP), the user threads 
process the cached pages. For pages that are only read by the user thread, the public 
view is used to access the necessary cache memory block, which may be read by 

1 0 multiple users. When an analysis requires modifying data, however, access through a 
public view is inappropriate. Instead, the cache memory block pointed to by the public 
view is copied to a new cache memory block. The user thread is then assigned a private 
pointer to the copied pages, and can modify the data in this private view without 
affecting data viewed by other threads. 

1 5 The resource managers ensure that the user threads cooperate to function 

effectively. In particular, a paging manager interfaces the user threads with the cache 
memory space to retrieve pages from disk. 

In accordance with a preferred embodiment of the invention, a computer- 
implemented program manages memory in a computer having a plurality of memory 

2 0 blocks. These memory blocks are preferably a cache memory area. Data is stored in 
memory blocks, including a first memory block and a second memory block. First and 
second user sessions or user threads execute in the computer, with the first user session 
having a global view of the first memory block data and the second user session having 
a global view of the first memory block data and a private view of the second memory 

2 5 block data. In a particular, the first and second user sessions are threads in a multi- 
threaded computer system. 
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The user threads preferably execute resource manager instructions to map data 
stored in a cache memory block with a location of the cache memory block in the 
computer. The resource manager also transfers data from a database into a cache 
memory block and stores generational views of the data. Preferably, the data is 
5 retrieved from a multi-dimensional database. 

A particular method facilitates simultaneous analysis of data in multiple sessions 
in a computer. First, data is retrieved from storage into public blocks of a shared 
memory space. These public blocks store data for global read access by a plurality of 
user sessions. Second, public blocks of data are selectively copied into private blocks of 

1 0 the shared memory space. Each private block stores data for private read and write 
access by a single user session. Upon read access to a data item by a user session, the 
data item is read if present from a private block accessible by the user session. If the 
data item is not present on a private block accessible by the user session, the data item is 
read from a public block. Upon write access to a data item by the user session, the data 

1 5 item is written to a private block if present in a private block accessible by the user 

session. If the private block is not already present, then data is copied from a public to a 
private block for access by the user session. 

Preferably, the user sessions and resource managers are implemented as 
processing threads in a multi-threaded computing system. In particular, the computing 

2 0 system can include a plurality of processing units for executing the threads. However, 
aspects of the invention can also be applied to processes in a multi-process architecture. 
As such, the term data accessor will be understood to encompass any computing 
mechanism to access or manipulate data, including threads and processes. 

The above and other features of the invention, including various novel details of 

2 5 construction and combination of parts, will now be more particularly described with 
reference to the accompanying drawings and pointed out in the claims. It will be 
understood that the particular computing system for implementing a shared cache 
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embodying the invention is shown by way of illustration only and not as a limitation of 
the invention. The principles and features of this invention may be embodied in varied 
and numerous embodiments without departing from the scope of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 
5 FIG. 1 is a schematic block diagram of an on-line analytical processing system 

embodying the invention. 

FIG. 2 is a schematic block diagram of a preferred page management system. 

FIGS. 3A-3B are schematic block diagrams of a private workspace and a global 
workspace index structure, respectively, 
1 0 FIG. 4 is a schematic block diagram of a page control block. 

FIGS. 5A-5B illustrate a flow chart of a fetch for read operation in accordance 
with a preferred embodiment of the invention. 

FIGS. 6A-6B illustrate a flow chart of a fetch for write operation in accordance 
with a preferred embodiment of the invention. 
1 5 FIGS. 7A-7B illustrate a flow chart of a collector operation in accordance with a 

preferred embodiment of the invention. 

FIG. 8 illustrates a flow chart of a flusher operation in accordance with a 
preferred embodiment of the invention. 

DETAILED DESCRIPTION OF PREFERRED 
2 0 EMBODIMENTS OF THE INVENTION 

FIG. 1 is a schematic block diagram of an on-line analytic processing (OLAP) 
system embodying the invention. A server 1 responds to requests from a plurality of 
client users 20 1? 20 2 , 20 n . To satisfy client requests, the server 1 retrieves data from a 
data storage warehouse 30, which can include various databases, such as relational 
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databases 32, multi-dimensional databases 34 and temporary databases 36 stored on 
disk. 

The server 1 includes at least one central processing unit (CPU) 2 l5 2 2 , 2 p . 
The CPUs 2 execute client or user sessions and system management processes to 
5 operate on data stored in memory 10, which includes an OLAP engine 12 and a cache 
memory 18. The OLAP engine 12 includes a kernel 13, a paging manager 15 and a 
thread manager 1 7. The user sessions preferably execute paging manager instructions, 
including page transfer functions 16, to manage pages in memory. 

The user sessions and system management processes preferably include 

1 0 processing threads managed by the thread manager 17 in a multi-threaded OLAP engine 
12. That is, user sessions can accomplish tasks by asynchronously executing processing 
threads. Embodiments of the invention preferably take the form of computer executable 
instructions embedded in a computer-readable format on a CD-ROM, floppy or hard 
disk, or another computer-readable distribution medium. These instructions are 

1 5 executed by one or more CPUs 2 U 2 2 , 2 p to implement the OLAP engine 12. A 
particular embodiment of the invention is commercially available as Oracle Express 
Server, version 6.0, from Oracle Corporation. 

FIG. 2 is a schematic block diagram of a preferred page management system. 
The paging manager 15 receives page requests from the client users 20 19 20 2 , 20 n and 

2 0 insures that current pages are retrieved from disk 30 and stored in the shared cache 
memory 18. The cache memory 1 8 can be global memory or memory assigned to the 
OLAP application by the server operating system. 

The paging manager 15 includes a private memory section 40 p and a public 
memory section 40 G . The private section 40 P can include a plurality of private 

2 5 workspaces 41 u 41 2 , 41 n . There is one private workspace 41 for each user session. 
A private workspace 41 includes private pagespace views 50a, 50b, 50z, which 
record information about writable pagespaces referenced by the current user session. 
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The public section 40 G is organized based on open databases. For ease of 
understanding, the system is illustrated as having one open database. However, it 
should be understood that there are generally a plurality of open databases being 
accessed by the client users. For each open database there is a public workspace 45 in 
5 the public memory section 40 G having, in general, a plurality of generational pagespace 
views 60a, 60b, 60g. Each private pagespace view 50 is associated with a particular 
generation of the database. For ease of description, preferred embodiments of the 
invention will be described with reference to a single database having a single 
generation in memory. 

10 The cache memory 18 includes page buffers 84 1? 84 2 , 84 x each having an 

associated page control block (PCB) 82 1? 82 2 , 82 x . Each page buffer 84 holds a page 
of data read from storage 30. In accordance with a preferred embodiment of the 
invention, the page buffers 84 each store data in blocks of 4K bytes, defined as a page. 
It should be understood that the page size can be chosen to be either less than or greater 

1 5 than 4K bytes. The page control blocks 82 include data fields used to control and access 
associated page buffers 84. The cache memory 1 8 is shared by the user sessions to store 
both public and private data. 

It is important to note that there is no physical division between public and 
private data pages. That is, a particular page buffer 84 simply stores a page of data, 

2 0 which can be either public or private data. It is up to the OLAP engine 12 to logically 
separate public and private data pages. In particular, the OLAP engine 12 relies on the 
public workspace 45 and the private workspaces 41 x ,...,41 n which include indexes to the 
appropriate page control blocks 82 i ,...,82 x . 

FIGS. 3A-3B are schematic block diagrams of a private workspace index 

2 5 structure 55 and a public workspace index structure 65, respectively. The index 
structures 55, 65 are included within a pagespace handle and are indexed by a page 
number 54, 64 within the associated pagespace. There is preferably one private index 
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structure 55 stored in session memory for each pagespace per session. Similarly, there 
is one public index structure 65 for each open and sharable pagespace. In a particular 
preferred embodiment, the index structures 55, 65 are a B-tree, but other look-up 
structures can be substituted to meet particular objectives. 
5 From the index structures 55, 65, a database record number 56, 66 and a page 

control block pointer 58, 68 are available if the page is within the respective view. If 
not null, the database record number 56, 66 identifies the record number in the database 
which holds the requested page. If the page is stored in the cache 18, the page control 
block pointer 58, 68 points to the page control block 82 associated with the page buffer 
10 84 in which the referenced record is stored. 

FIG. 4 is a schematic block diagram of a page control block structure. Each 
page control block 82 includes a most-recently-used (MRU) time field 91, a lock flag 
93, an owner workspace pointer 95, and a version control field 97. The page control 
block 82 also includes additional fields used by other components of the computer 
1 5 paging subsystem and which are not shown. 

A user session uses the above architecture by executing paging manager code. 
For data to be processed by a session, the data must be retrieved from mass storage 30 
and stored in a page buffer 84 in the cache 18. Once the data is retrieved, the page 
buffer 84 can be publicly accessed by any user session. If the data is to be modified, 
2 0 such as for a what-if analysis, then the data is copied to a private page buffer, leaving 
the original data in the public page buffer. Details of fetching data into the cache 1 8 
will now be described in detail. 

FIGS. 5A-5B illustrate a flow chart of a fetch for read operation 100 in 
accordance with a preferred embodiment of the invention. For a read operation, a user 
2 5 session thread passes, through a page transfer function 1 6 (FIG. 1), a pagespace handle 
and a page number along with a read access privilege mask. At step 105, the function 
attempts to check the private view for the referenced pagespace. At step 1 07, if a 
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private index structure 55 does not exist for this pagespace, processing jumps to step 
120 to search the global view. Otherwise, the pagespace is in the private view and 
processing continues to step 110. 

At step 110, the private page control block pointer 58 is tested. If the private 
5 pointer 58 is valid (e.g., not null), then the page is stored in a buffer in cache memory 
and processing jumps to step 180. If the private pointer 58 is invalid (e.g., null), then 
the page is not in the cache memory 18 and processing continues to step 115. 

At step 115, the private record number field 56 is compared against null. If the 
private record number field 56 is null, then the user does not have access to the page. If 
1 0 the private record number field 56 is not null, then the user session has private access to 
the page, but it has been written from the cache to the database 32, 34 (or a temporary 
database 36) on disk 30. 

Where the user session does not have private access to the page (steps 107, 11 5), 
the operation checks the public view for the pagespace at step 120. At step 122, if a 
15 public index structure 65 does not exist for this pagespace, then processing jumps to 
step 135 to search for the database record. Otherwise, the pagespace is in the public 
view and processing continues to step 125. 

At step 125, the public page control block pointer 68 is tested. If the public 
pointer 68 is valid (e.g., not null), then the page is in memory and processing jumps to 
2 0 step 180. If the public pointer 68 is invalid (e.g., null), then the record is not currently 
in cache memory and processing continues to step 130. 

At step 130, the public record number field 66 is tested against null If the 
public record number field 66 is null, then the page has not been loaded into memory 
and processing continues to step 135, where the pagespace is converted to a database 
2 5 record using a record map on disk for the particular database. On the other hand, if the 
public record number 66 is not null, then the database record is known to the paging 
manager. Processing now continues to step 140. 
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At step 140, the data is retrieved from disk to a free page buffer taken from a 
free buffer list (described in detail below). At step 145, the associated page control 
block fields are set to indicate public ownership. In particular, the owner workspace 
field 95 is set to null At step 155, the public index structure 65 is updated to record the 
5 public database record number 66 and the public page control block pointer 68 is set to 
point to the page control block 82. Processing then continues to step 180. 

Returning to step 160, because the database record had already been retrieved 
from storage into a private workspace, it was written to the disk 30. The private 
database record number field 56 identifies the location of the data on the disk, either in 
1 0 the database 32, 34 or in a temporary database 36. At step 160, the page is retrieved 
from disk storage and placed into a free page buffer from the free buffer list (described 
in detail below). At step 170, the page control block fields are set to indicate private 
ownership by setting the owner field 95 to identify the owner workspace. Processing 
then continues to step 180. 
15 At step 1 80, the user session can locate the data in a privately accessible page 

buffer 82. The data is now available to be read by the user session. 

Initially, a fetch for write operation is similar to the fetch for read operation. In a 
fetch for write operation, however, the read page is copied to another, private, page 
buffer. 

2 0 FIGS. 6A-6B illustrate a flow chart of a fetch for write operation 200 in 

accordance with a preferred embodiment of the invention. At step 205, the write 
operation 200 checks the private view for the requested pagespace. At step 207, if a 
private index structure 55 does not exist for this pagespace, processing jumps to step 
220 to search the global view. Otherwise, the pagespace is already in the private view 

2 5 and processing continues to step 2 1 0. 

At step 210, the private page control block pointer 58 is checked. If the private 
pointer 58 is valid (e.g, not null), then the page having the record has already been 
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loaded into the cache memory 18 and is available for write access. In that case, 
processing jumps to step 285. On the other hand, if the private pointer 58 is invalid 
(e.g., null), then the page does not currently exist in the private cache memory 18 and 
processing continues to step 215. 
5 At step 215, the database record number 56 is compared against null If the 

record number 56 is null, then the requested page has not been loaded into memory for 
write access in the private view and processing continues to step 220. If the record 
number 56 is not null, then the page has previously been read into the cache and 
temporarily stored in the database 32, 34 or a temporary database 36 on disk. In that 

1 0 case, processing jumps to step 265 . 

At step 220, the public view is checked for the pagespace. At step 222, if a 
public index structure 65 does not exist for this pagespace, the processing jumps to step 
235 to search for the database record. Otherwise, the pagespace is in the public view 
and processing continues to step 225. 

15 At step 225, the public page control block pointer 68 is checked. If the public 

pointer 68 is valid (e.g., not null), then the page currently exists in the cache memory 18 
and processing jumps to step 260. If the public pointer 68 is invalid (e.g., null), then the 
record is not available in the cache 18 for public access and processing continues to step 
230. 

2 0 At step 230, the public database record number 66 is compared against null. If 

the public record number field 66 is null, then the record has not previously been loaded 
into the cache memory 18 and processing continues to step 235 where the pagespace is 
converted to a database record. If the record number 66 is not null, then the data can be 
accessed using the stored record number and processing jumps to step 240. 

2 5 At step 240, the page is retrieved from disk into a free page buffer (described in 

detail below). At step 245, the page control block fields are set to indicate public 
access. In particular, the owner workspace field 95 is set to null. At step 255, the 
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public index data fields 66, 68 are updated to identify and point to the public page 
control block. 

At step 260, the data from the public page buffer is copied to another free page 
buffer. At step 275, the page control block fields are set to indicate private ownership 
5 as described above. At step 280, the private index fields 56, 58 for the user process is 
updated to identify and point to this private page control block. 

At step 285, the page buffer is available for write access to the user process. The 
user process can now continue the write operation to the privately accessible cache 
buffer. 

10 As discussed above, pages retrieved from disk 30 are stored into a free page 

buffer 84. To facilitate this function, the paging manager maintains a list of all free 
page buffers 84. For example, a free list pointer can point to a linked list of page 
control blocks 82 associated with free page buffers 84. When the paging manager needs 
a free buffer, the first page control block on the free list is popped from the top of the 

15 linked list, moving the free list pointer to the next page control block in the linked list. 

In accordance with a preferred embodiment of the invention, the user sessions do 
not directly maintain the cache memory area. Because of the particular use of 
pagespaces and pointers to denote page ownership, a user session requiring a new page 
may deadlock with another user session. In such a situation, each user session can be 

2 0 referencing a page which the other user session has chosen to swap from memory. To 
avoid such a deadlock, a separate dedicated collector thread is utilized to manage page 
removal from the cache memory area. 

In a multi-threaded environment, user sessions can also be multi-tasked into a 
plurality of processing threads. In an active system, processing threads can become 

2 5 active in bursts, causing high page fault rates. This situation can be particularly 
troublesome in an OLAP system where processing threads can operate on a large 
amount of page data from large multi-dimensional databases. In typical prior art 
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systems, data is either stored locally within a user process space or global page buffers 
are freed to satisfy the page requests. This process of freeing a global page buffer on 
demand before data can be retrieved from disk delays the user sessions. 

To minimize processing delays which can occur when the free list becomes 
5 empty, the paging manager 15 maintains a counter of the number of entries on the free 
list. Every time a page control block is removed from the free list, the count in 
compared with a minimum threshold value. If the minimum threshold is met, then the 
paging manager begins a collecting operation to free up additional page buffers. The 
minimum threshold value is chosen based on a historical operational profile of the 

1 0 system to maximize the number of page buffers 84 in use while reducing the chances 
that there are no free page buffers at any time. For example, the minimum threshold 
value can be initially chosen to be 10% of the total page buffers. The minimum 
threshold can also be dynamically adjusted by the paging manager over time. 

FIG. 7A-7B illustrate a flow chart of a collecting operation 300 in accordance 

1 5 with the preferred embodiment of the invention. Preferably, the collector operation 300 
is performed by a specialized thread in a multi-threaded environment to reduce 
contention and deadlock between user sessions. At step 305, the operation checks the 
startup condition. If a startup condition exists, then processing continues to step 307 
where the collector allocates cache memory from main memory. Processing then jumps 

20 to step 380. 

If this is not a startup condition, processing continues to step 310. At step 310, 
the collector scans the page control blocks for the least-recently-used (LRU) candidate. 
In particular, the collector reads the MRU time field 91 from each page control block 
82 l9 82 2 , 82 x . The page control block having the earliest MRU time, is the LRU 
2 5 candidate. At step 3 1 5, the collector locks the LRU candidate, thereby setting the lock 
field 93 in the page control block 82. At step 320, the collector rereads the MRU time 
field from the LRU candidate page control block. At step 325, the collector compares 
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the original time value with the reread time value to verify that the page has not been 
more recently used. 

If the compared time values do not match, then processing continues to step 330. 
At step 330, the collector unlocks the LRU candidate page control block and processing 
5 returns to step 3 1 0 to try again. 

If the time values agree (step 325), then the page is confirmed as the least- 
recently-used page and processing continues to step 335. At step 335, the owner field 
95 of the page control block 82 is checked. If the owner field 95 is set, then the page is 
private data to the user session identified by the owner field 95 and processing continues 
10 to step 340. At step 340, the collector causes the page buffer to be written to disk, such 
as an extended database 36. In particular, if an extension file needs to be created, the 
collector sends a message to the owner user session to do the file creation. Once the 
extension file exists, the collector writes to it itself. Processing then continues to step 
350. If the data has not been modified (as indicated by a null (i.e., public) owner field 
1 5 95), then the data is public data for read-only access. In that case, processing jumps to 
step 350 without rewriting the data to disk. 

At step 350, a check of the owner field 95 is again made to see if the field is not 
null (i.e., private data). If the page is private, processing continues to step 355, where 
the page control block pointer is removed from the private index structure 55 by setting 
2 0 the private pointer 58 to null. If the page is public, processing instead continues to step 
357 where the page control block pointer is removed from the public index structure 65 
by setting the public pointer 68 to null. 

At step 360, the version number 93 of the page in the page control block 82 is 
incremented. At step 365, the page control block is put onto a free list of available page 
2 5 control blocks. At step 370 the page control block is unlocked to make it available for 
re-use. 
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At step 375, the collector tests the number of page control blocks on the free list. 
If this number is above a preset maximum threshold, then processing continues to step 
380. If the maximum threshold has not yet been reached, processing returns to step 310 
to search for additional page control blocks to add to the free list. The maximum 
5 threshold value is preferably chosen to optimize the cache memory 1 8 based on past 
performances. For example, the maximum threshold can initially be twice the minimum 
threshold and can be dynamically adjusted by the paging manager. 

At step 380, the collector thread suspends itself. It is awakened again when the 
number of page control blocks on the free list is reduced to be below the previously- 

1 0 described minimum threshold level. The collector is preferably awakened by a write or 
read operation from a user session when a page buffer is taken from the free list (FIGs. 
5A-5B (140,160)); FIGs. 6A-6B (240,260,265)). 

Although the collector has been described as employing an LRU algorithm, 
other algorithms may be more particularly suitable. For example, in systems having 

1 5 large caches, the computations required to determine the LRU candidate can be very 
time consuming. It should be recognized, however, that the function of the collector is 
to maintain a buffer of free page slots, even during heavy page faulting, without 
blocking user threads. To accomplish this function, it is recognized that the candidate 
page slot does not have to be storing the LRU page. 

2 0 In accordance with another preferred embodiment, an "old enough" algorithm is 

employed to find a reclamation candidate that has not been recently used. Instead of the 
MRU time field 91, the collector preferably reads an internal counter field in the page 
control block, which can be faster to retrieve than a time field. By, for example, 
knowing the oldest counter value, the collector can determine a threshold counter value 

2 5 for those pages that are old enough to be reclaimed. Instead of looping through the 
entire page pool for the single LRU candidate, the collector can stop the search when 
finding the first page having a counter which exceeds the threshold; with the realization 
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that this page is likely to be eventually reclaimed under the LRU algorithm anyway. By 
using such an "old enough" algorithm, the amount of CPU time required by the collector 
can be reduced to a few percent of that required for the LRU algorithm. 

hi an OLAP system, most data retrieved from storage is read-only data, which is 
5 easier to remove from the cache memory than modified data. Any session, however, 
can cause data in the cache memory to be privately modified. This data may only be 
used for a relatively brief period of time, but may tend to stay in the cache memory, 
using the server's page buffers for a private function. Although that situation is 
acceptable for short time periods, if left unattended much of the cache memory blocks 

1 0 can be allocated as private memory. In accordance with another aspect of the invention, 
modified pages are flushed to temporary storage when not in use. According to 
protocol, a page is guaranteed to be in a page buffer only if locked by a process thread. 
Any unlocked page is free to be flushed. 

FIG. 8 illustrates a flow chart of a flusher operation 400 in accordance with the 

15 preferred embodiment of the invention. The flusher operation 400 is preferably 

performed by an independent flusher thread. Preferably, the flusher thread is activated 
by a periodic timer event. For example, the flusher thread can be run eveiy 30 seconds 
to flush modified and unlocked pages to temporary storage from the cache memory area. 
In accordance with a preferred embodiment of the invention, the flusher thread is 

2 0 executed on one processor in a multi-processor server. 

At step 405, the flusher scans the page control blocks for a modified buffer as 
indicated by having a set owner field 95. At step 410, the lock bit 93 of the modified 
buffer is checked. If the buffer is locked, processing returns to step 405 to find the next 
modified buffer. 

2 5 If the buffer is not locked, the buffer is flushed at step 415. At step 420, the 

flusher checks to see if it has searched the entire cache memory area. If so, the flusher is 
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finished and suspends itself at step 425. If the flushing task has not yet finished, 
processing returns to step 405. 

EQUIVALENTS 

While the invention has been particularly shown and described with reference to 
5 preferred embodiments thereof, it will be understood to those skilled in the art that 
various changes in form and detail can be made without departing from the spirit and 
scope of the invention as defined by the appended claims. For example, although the 
invention has been described with reference to particular hardware and software 
embodiments, it will be understood that various aspects of the invention can be 
1 0 embodied in either hardware, software or firmware. 

These and all other equivalents are intended to be encompassed by the following 

claims. 



